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AMENDMENTS TO THE CLAIMS 
This listing of claims will replace all prior versions and listings of claims in the 

application: 

LISTING OF CLAIMS: 

1. (canceled). 

2. (previously presented): An image comparison device comprising: 

a registration means for obtaining and registering 3-D data of all or part of one or more 
registered objects; and 

a comparison means for obtaining 2-D data of a target object and comparing the obtained 
2-D data with the data registered in the registration means for conducting judgment concerning 
the similarity/sameness between the target object and each of the one or more registered objects, 
wherein the comparison means includes: 

a photographing means for photographing the target object and thereby obtaining an input 

image; 

a position/pose determination means for determining the position/pose of the target object 
in the input image obtained by the photographing means; 

an illumination correction means for generating an image of each registered object in the 
same position/pose as the target object in the input image and under an illumination condition 
most similar to that of the input image as a reference image by use of the position/pose 
determined by the position/pose determination means and the data registered in the registration 
means; 



2 



AMENDMENT UNDER 37 C.F.R. § 1.114(c) Q63913 
U.S. Application No. 09/823,763 

an image comparison means for comparing each reference image generated by the 
illumination correction means with the input image obtained by the photographing means and 
thereby calculating an evaluation value concerning the similarity between the two images; and 

a judgment means forjudging whether or not each of the registered objects registered in 
the registration means is the same as or similar to the target object photographed by the 
photographing means based on the evaluation value calculated by the image comparison means. 

3. (withdrawn): An image comparison device as claimed in claim 2, wherein the 
registration means includes: 

a 3-D shape measurement means for measuring the 3-D shape of each registered object; 

a reflectance measurement means for measuring the reflectance at each position on the 
surface of the 3-D shape of the registered object; and 

a data storage means for storing the 3-D shapes measured by the 3-D shape measurement 
means and the reflectance measured by the reflectance measurement means as the registered 
data. 

4. (original): An image comparison device as claimed in claim 2, wherein the 
registration means includes: 

a 3-D shape measurement means for measuring the 3-D shapes of all or part of the one or 

more registered objects; 

a color/intensity measurement means for photographing the registered object and thereby 

obtaining information concerning color or intensity of the registered object; and 
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a data storage means for storing the 3-D shapes measured by the 3-D shape measurement 
means and the color/intensity information obtained by the color/intensity measurement means as 
the registered data. 

5. (withdrawn): An image comparison device as claimed in claim 2, wherein the 
registration means includes: 

a 3-D shape measurement means for measuring the 3-D shapes of all or part of the one or 
more registered objects; 

an average shape generation means for generating an average 3-D shape as the average of 
one or more of the 3-D shapes measured by the 3-D shape measurement means; 

a reflectance measurement means for measuring the reflectance at each position on the 
surface of the 3-D shape of the registered object; and 

a data storage means for storing the 3-D shapes measured by the 3-D shape measurement 
means, the average 3-D shape generated by the average shape generation means and the 
reflectance measured by the reflectance measurement means as the registered data. 

6. (original): An image comparison device as claimed in claim 2, wherein the 
illumination correction means includes: 

an image generation means for generating images of each registered object in the same 

position/pose as the target object in the input image and under various illumination conditions as 

illumination variation images by use of the position/pose estimated by the position/pose 

determination means and the data registered in the registration means; and 
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an illumination condition estimation means for generating an image that is the most 
similar to the input image obtained by the photographing means by use of the illumination 
variation images generated by the image generation means and outputting the generated image to 
the image comparison means as the reference image. 

7. (original): An image comparison device as claimed in claim 6, wherein: 

the illumination correction means further includes an illumination variation image space 
generation means for generating an illumination variation image space which is spanned by the 
illumination variation images generated by the image generation means, and 

the illumination condition estimation means generates the image that is the most similar 
to the input image from the illumination variation image space generated by the illumination 
variation image space generation means and outputs the generated image to the image 
comparison means as the reference image. 

8. (original): An image comparison device as claimed in claim 7, wherein: 

the illumination variation image space generation means generates basis vectors of a 
space that almost accommodates image variation due to the illumination variation by conducting 
principal component analysis (PCA) to the illumination variation images generated by the image 
generation means, and 

the illumination condition estimation means obtains inner products between the input 

image obtained by the photographing means and each of the basis vectors generated by the 

illumination variation image space generation means, generates the image that is the most similar 
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to the input image by use of the basis vectors and based on the inner products, and outputs the 
generated image to the image comparison means as the reference image. 

9. (original): An image comparison device as claimed in claim 6, wherein the 
illumination correction means further includes an illumination condition variation means for 
setting various illumination conditions and outputting the illumination conditions to the image 
generation means. 

10. (withdrawn): An image comparison device as claimed in claim 2, wherein: 
the registration means includes: 

a 3-D shape measurement means for measuring the 3-D shape of each registered object; 

a texture image photographing means for photographing the registered object under 
various illumination conditions and thereby obtaining texture images of the registered object; and 

a data storage means for storing the 3-D shapes measured by the 3-D shape measurement 
means and the texture images obtained by the texture image photographing means as the 
registered data, and 

the illumination correction means includes: 

an image generation means for generating images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions as 
illumination variation images by use of the position/pose determined by the position/pose 
determination means and the 3-D shapes and the texture images of the registered object 
registered in the registration means; and 
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an illumination condition estimation means for generating an image that is the most 
similar to the input image obtained by the photographing means by use of the illumination 
variation images generated by the image generation means and outputting the generated image to 
the image comparison means as the reference image. 

1 1. (withdrawn): An image comparison device as claimed in claim 10, wherein the 
illumination correction means further includes an illumination variation image space generation 
means for generating an illumination variation image space which is spanned by the illumination 
variation images generated by the image generation means, and 

the illumination condition estimation means generates the image that is the most similar 
to the input image from the illumination variation image space generated by the illumination 
variation image space generation means and outputs the generated image to the image 
comparison means as the reference image. 

12. (withdrawn): An image comparison device as claimed in claim 1 1, wherein: 
the illumination variation image space generation means generates basis vectors of a 

space that almost accommodates image variation due to the illumination variation by conducting 

the principal component analysis (PCA) to the illumination variation images generated by the 

image generation means, and 

the illumination condition estimation means obtains inner products between the input 

image obtained by the photographing means and each of the basis vectors generated by the 

illumination variation image space generation means, generates the image that is the most similar 
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to the input image by use of the basis vectors and based on the inner products, and outputs the 
generated image to the image comparison means as the reference image. 

13. (original): An image comparison device as claimed in claim 2, wherein the 
position/pose determination means outputs a predetermined position/pose to the illumination 
correction means. 

14. (original): An image comparison device as claimed in claim 2, wherein the 
position/pose determination means receives inputs concerning position/pose from outside, and 
outputs the received position/pose to the illumination correction means. 

15. (original): An image comparison device as claimed in claim 2, wherein the 
position/pose determination means estimates the position/pose of the target object in the input 
image obtained by the photographing means, and outputs the estimated position/pose to the 
illumination correction means. 

16. (withdrawn): An image comparison device as claimed in claim 15, wherein: 
the registration means includes: 

a 3-D shape measurement means for measuring the 3-D shape of each registered object; 
a reflectance measurement means for measuring the reflectance at each position on the 
surface of the 3-D shape of the registered object; 
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a first feature point extraction means for extracting feature points of the registered object 
based on the 3-D shape measured by the 3-D shape measurement means and the reflectance 
measured by the reflectance measurement means and obtaining the positions of the extracted 
feature points; and 

a data storage means for storing the 3-D shapes measured by the 3-D shape measurement 
means, the reflectance measured by the reflectance measurement means and the feature point 
positions obtained by the first feature point extraction means as the registered data, and 

the position/pose determination means includes: 

a second feature point extraction means for extracting feature points corresponding to 
those extracted by the first feature point extraction means from the input image obtained by the 
photographing means and obtaining the positions of the extracted feature points; and 

a position/pose calculation means for estimating the position/pose of the target object in 
the input image based on the 3-D shape and the feature point positions stored in the data storage 
means and the input image feature point positions obtained by the second feature point extraction 
means and outputting the estimated position/pose to the illumination correction means. 

17. (withdrawn): An image comparison device as claimed in claim 16, wherein the 
illumination correction means includes: 

an image generation means for generating images of each registered object in the same 

position/pose as the target object in the input image and under various illumination conditions as 

illumination variation images by use of the position/pose estimated by the position/pose 

determination means and the 3-D shape and the reflectance stored in the data storage means; and 
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an illumination condition estimation means for generating an image that is the most 
similar to the input image obtained by the photographing means by use of the illumination 
variation images generated by the image generation means and outputting the generated image to 
the image comparison means as the reference image. 

18. (withdrawn): An image comparison device as claimed in claim 17, wherein: 

the illumination correction means further includes an illumination variation image space 
generation means for generating an illumination variation image space which is spanned by the 
illumination variation images generated by the image generation means, and 

the illumination condition estimation means generates the image that is the most similar 
to the input image from the illumination variation image space generated by the illumination 
variation image space generation means and outputs the generated image to the image 
comparison means as the reference image. 

19. (withdrawn): An image comparison device as claimed in claim 18, wherein: 
the illumination variation image space generation means generates basis vectors of a 

space that almost accommodates image variation due to the illumination variation by conducting 

principal component analysis (PCA) to the illumination variation images generated by the image 

generation means, and 

the illumination condition estimation means obtains inner products between the input 

image obtained by the photographing means and each of the basis vectors generated by the 

illumination variation image space generation means, generates the image that is the most similar 
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to the input image by use of the basis vectors and based on the inner products, and outputs the 
generated image to the image comparison means as the reference image. 

20. (withdrawn): An image comparison device as claimed in claim 19, wherein the 
illumination correction means further includes an illumination condition variation means for 
setting various illumination conditions and outputting the illumination conditions to the image 
generation means. 

21. (previously presented): An image comparison device comprising: 

a registration means for obtaining and registering 3-D data of all or part of one or more 
registered objects; and 

a comparison means for obtaining 2-D data of a target object and comparing the obtained 
2-D data with the data registered in the registration means for conducting judgment concerning 
the similarity/sameness between the target object and each of the one or more registered objects, 
wherein: 

the registration means includes: 

a 3-D shape measurement means for measuring the 3-D shape of each registered object; 

a reflectance measurement means for measuring the reflectance at each position on the 
surface of the 3-D shape of the registered object; 

an image generation means for generating images of each registered object under various 
illumination conditions as illumination variation images; 
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an illumination variation image space generation means for generating an illumination 
variation image space which is spanned by the illumination variation images generated by the 
image generation means; and 

a data storage means for storing the illumination variation image space generated by the 
illumination variation image space generation means as the registered data, and 

the comparison means includes: 

a photographing means for photographing the target object and thereby obtaining an input 

image; 

an illumination condition estimation means for generating an image of each registered 
object that is the most similar to the input image as a reference image from the illumination 
variation image space stored in the data storage means; 

an image comparison means for comparing each reference image generated by the 
illumination condition estimation means with the input image obtained by the photographing 
means and thereby calculating an evaluation value concerning the similarity between the two 
images; and 

a judgment means forjudging whether or not each of the registered objects registered in 
the registration means is the same as or similar to the target object photographed by the 
photographing means based on the evaluation value calculated by the image comparison means. 
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22. (original): An image comparison device as claimed in claim 21, wherein: 

the illumination variation image space generation means generates basis vectors of a 
space that almost accommodates image variation due to the illumination variation by conducting 
principal component analysis (PCA) to the illumination variation images generated by the image 
generation means, and 

the data storage means stores the basis vectors generated by the illumination variation 
image space generation means as the registered data, and 

the illumination condition estimation means obtains inner products between the input 
image obtained by the photographing means and each of the basis vectors stored in the data 
storage means, generates the image that is the most similar to the input image by use of the basis 
vectors and based on the inner products, and outputs the generated image to the image 
comparison means as the reference image. 

23. (withdrawn): An image comparison device as claimed in claim 3, wherein the 3-D 
shape measurement means obtains the 3-D shapes by reading data or drawings. 

24. (original): An image comparison device as claimed in claim 4, wherein the 3-D 
shape measurement means obtains the 3-D shapes by reading data or drawings. 

25. (withdrawn): An image comparison device as claimed in claim 10, wherein the 3-D 

shape measurement means obtains the 3-D shapes by reading data or drawings. 
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26. (withdrawn): An image comparison device as claimed in claim 3, wherein the 
reflectance measurement means obtains the reflectance by reading data or drawings. 

27. (original): An image comparison device as claimed in claim 2, wherein the 
photographing means obtains the input image by scanning a film, a photograph or printed matter. 

28. (original): An image comparison device as claimed in claim 2, wherein the judgment 
means judges which registered object matches the target object. 

29. (original): An image comparison device as claimed in claim 2, wherein the judgment 
means searches for one or more registered objects that are similar to the target object. 

30. (previously presented): An image comparison device as claimed in claim 2, wherein 
the registered objects are automobiles. 

31. (canceled). 

32. (canceled). 

33. (previously presented): An image comparison method comprising the steps of: 
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a registration step in which 3-D data of all or part of one or more registered objects are 
obtained and registered; and 

a comparison step in which 2-D data of a target object is obtained and the obtained 2-D 
data is compared with the data registered in the registration step for conducting j udgment 
concerning the similarity/sameness between the target object and each of the one or more 
registered objects., wherein the comparison step includes: 

a photographing step in which the target object is photographed and thereby an input 
image is obtained; 

a position/pose determination step in which the position/pose of the target object in the 
input image obtained in the photographing step is determined; 

an illumination correction step in which an image of each registered object in the same 
position/pose as the target object in the input image and under an illumination condition most 
similar to that of the input image is obtained as a reference image by use of the position/pose 
determined in the position/pose determination step and the data registered in the registration step; 

an image comparison step in which each reference image generated in the illumination 
correction step is compared with the input image obtained in the photographing step and thereby 
an evaluation value concerning the similarity between the two images is calculated; and 

a judgment step in which it is judged whether or not each of the registered objects 
registered in the registration step is the same as or similar to the target object photographed in the 
photographing step based on the evaluation value calculated in the image comparison step. 
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34. (withdrawn): An image comparison method as claimed in claim 33, wherein the 
registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the reflectance measured in the reflectance measurement step are stored as the registered 
data. 

35. (original): An image comparison method as claimed in claim 33, wherein the 
registration step includes: 

a 3-D shape measurement step in which the 3-D shapes of all or part of the one or more 
registered objects are measured; 

a color/intensity measurement step in which the registered object is photographed and 
thereby information concerning color or intensity of the registered object is obtained; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the color/intensity information obtained in the color/intensity measurement step are stored as 
the registered data. 

36. (withdrawn): An image comparison method as claimed in claim 33, wherein the 
registration step includes: 
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a 3-D shape measurement step in which the 3-D shapes of all or part of the one or more 
registered objects are measured; 

an average shape generation step in which an average 3-D shape is generated as the 
average of one or more of the 3-D shapes measured in the 3-D shape measurement step; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step, 
the average 3-D shape generated in the average shape generation step and the reflectance 
measured in the reflectance measurement step are stored as the registered data. 

37. (original): An image comparison method as claimed in claim 33, wherein the 
illumination correction step includes: 

an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose estimated in the 
position/pose determination step and the data registered in the registration step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

38. (original): An image comparison method as claimed in claim 37, wherein: 
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the illumination correction step further includes an illumination variation image space 
generation step in which an illumination variation image space which is spanned by the 
illumination variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

39. (original): An image comparison method as claimed in claim 38, wherein: 

in the illumination variation image space generation step, basis vectors of a space that 
almost accommodates image variation due to the illumination variation are generated by 
conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

40. (original): An image comparison method as claimed in claim 37, wherein the 
illumination correction step further includes an illumination condition variation step in which 
various illumination conditions are set and generated to be used in the image generation step. 
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41 . (withdrawn): An image comparison method as claimed in claim 33, wherein: 
the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a texture image photographing step in which the registered object is photographed under 
various illumination conditions and thereby texture images of the registered object are obtained; 
and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the texture images obtained in the texture image photographing step are stored as the 
registered data, and 

the illumination correction step includes: 

an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose determined in the 
position/pose determination step and the 3-D shapes and the texture images of the registered 
object registered in the registration step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

42. (withdrawn); An image comparison method as claimed in claim 41, wherein the 

illumination correction step further includes an illumination variation image space generation 
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step in which an illumination variation image space which is spanned by the illumination 
variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

43. (withdrawn): An image comparison method as claimed in claim 42, wherein: 

in the illumination variation image space generation step, basis vectors of a space that 
almost accommodates image variation due to the illumination variation are generated by 
conducting the principal component analysis (PCA) to the illumination variation images 
generated in the image generation step, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

44. (original): An image comparison method as claimed in claim 33, wherein in the 
position/pose determination step, a predetermined position/pose is adopted as the position/pose 
of the target object in the input image to be used in the illumination correction step. 
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45. (original): An image comparison method as claimed in claim 33, wherein in the 
position/pose determination step, a position/pose inputted from outside is adopted as the 
position/pose of the target object in the input image to be used in the illumination correction step. 

46. (original): An image comparison method as claimed in claim 33, wherein in the 
position/pose determination step, the position/pose of the target object in the input image 
obtained in the photographing step is estimated to be used in the illumination correction step. 

47. (withdrawn): An image comparison method as claimed in claim 46, wherein; 
the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; 

a first feature point extraction step in which feature points of the registered object are 
extracted based on the 3-D shape measured in the 3-D shape measurement step and the 
reflectance measured in the reflectance measurement step and the positions of the extracted 
feature points are obtained; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step, 

the reflectance measured in the reflectance measurement step and the feature point positions 

obtained in the first feature point extraction step are stored as the registered data, and 

the position/pose determination step includes: 
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a second feature point extraction step in which feature points corresponding to those 
extracted in the first feature point extraction step are extracted from the input image obtained in 
the photographing step and the positions of the extracted feature points are obtained; and 

a position/pose calculation step in which the position/pose of the target object in the input 
image is estimated based on the 3-D shape and the feature point positions stored in the data 
storage step and the input image feature point positions obtained in the second feature point 
extraction step. 

48. (withdrawn): An image comparison method as claimed in claim 47, wherein the 
illumination correction step includes: 

an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose estimated in the 
position/pose determination step and the 3-D shape and the reflectance stored in the data storage 
step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

49. (withdrawn): An image comparison method as claimed in claim 48, wherein: 
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the illumination correction step further includes an illumination variation image space 
generation step in which an illumination variation image space which is spanned by the 
illumination variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

50. (withdrawn): An image comparison method as claimed in claim 49, wherein: 

in the illumination variation image space generation step, basis vectors of a space that 
almost accommodates image variation due to the illumination variation are generated by 
conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

5 1 . (withdrawn): An image comparison method as claimed in claim 50, wherein the 
illumination correction step further includes an illumination condition variation step in which 
various illumination conditions are set and generated to be used in the image generation step. 
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52. (previously presented): An image comparison method comprising the steps of: 

a registration step in which 3-D data of all or part of one or more registered objects are 
obtained and registered; and 

a comparison step in which 2-D data of a target object is obtained and the obtained 2-D 
data is compared with the data registered in the registration step for conducting judgment 
concerning the similarity/sameness between the target object and each of the one or more 
registered objects., wherein: 

the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; 

an image generation step in which images of each registered object under various 
illumination conditions are generated as illumination variation images; 

an illumination variation image space generation step in which an illumination variation 
image space which is spanned by the illumination variation images generated in the image 
generation step is generated; and 

a data storage step in which the illumination variation image space generated in the 
illumination variation image space generation step is stored as the registered data, and 

the comparison step includes: 

a photographing step in which the target object is photographed and thereby an input 
image is obtained; 
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an illumination condition estimation step in which an image of each registered object that 
is the most similar to the input image is generated as a reference image from the illumination 
variation image space stored in the data storage step; 

an image comparison step in which each reference image generated in the illumination 
condition estimation step is compared with the input image obtained in the photographing step 
and thereby an evaluation value concerning the similarity between the two images is calculated; 
and 

a judgment step in which it is judged whether or not each of the registered objects 
registered in the registration step is the same as or similar to the target object photographed in the 
photographing step based on the evaluation value calculated in the image comparison step. 

53. (original): An image comparison method as claimed in claim 52, wherein: 

in the illumination variation image space generation step, basis vectors of a space that 
almost accommodates image variation due to the illumination variation are generated by 
conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 

in the data storage step, the basis vectors generated in the illumination variation image 
space generation step are stored as the registered data, and 

in the illumination condition estimation step, inner products are obtained between the 

input image obtained in the photographing step and each of the basis vectors stored in the data 

storage step, and the image that is the most similar to the input image is generated as the 

reference image by use of the basis vectors and based on the inner products. 
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54. (withdrawn): An image comparison method as claimed in claim 34, wherein in the 
3-D shape measurement step, the 3-D shapes are obtained by reading data or drawings. 

55. (original): An image comparison method as claimed in claim 35, wherein in the 3-D 
shape measurement step, the 3-D shapes are obtained by reading data or drawings. 

56. (withdrawn): An image comparison method as claimed in claim 41, wherein in the 
3-D shape measurement step, the 3-D shapes are obtained by reading data or drawings, 

57. (withdrawn): An image comparison method as claimed in claim 34, wherein in the 
reflectance measurement step, the reflectance is obtained by reading data or drawings. 

58. (original): An image comparison method as claimed in claim 33, wherein in the 
photographing step, the input image is obtained by scanning a film, a photograph or printed 
matter. 

59. (original): An image comparison method as claimed in claim 33, wherein the 
judgment step is executed forjudging which registered object matches the target object. 
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60. (original): An image comparison method as claimed in claim 33, wherein the 
judgment step is executed for searching for one or more registered objects that are similar to the 
target object. 

61. (previously presented): An image comparison method as claimed in claim 33, 
wherein the registered objects are automobiles. 

62. (canceled). 

63. (canceled). 

64. (previously presented): A machine-readable record medium storing one or more 
programs for instructing one or more computers, devices, MPUs (Microprocessor Units), etc. to 
execute an image comparison process comprising the steps of: 

a registration step in which 3-D data of all or part of one or more registered objects are 
obtained and registered; and 

a comparison step in which 2-D data of a target object is obtained and the obtained 2-D 
data is compared with the data registered in the registration step for conducting judgment 
concerning the similarity/sameness between the target object and each of the one or more 
registered objects., wherein the comparison step includes: 

a photographing step in which the target object is photographed and thereby an input 
image is obtained; 
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a position/pose determination step in which the position/pose of the target object in the 
input image obtained in the photographing step is determined; 

an illumination correction step in which an image of each registered object in the same 
position/pose as the target object in the input image and under an illumination condition most 
similar to that of the input image is obtained as a reference image by use of the position/pose 
determined in the position/pose determination step and the data registered in the registration step; 

an image comparison step in which each reference image generated in the illumination 
correction step is compared with the input image obtained in the photographing step and thereby 
an evaluation value concerning the similarity between the two images is calculated; and 

a judgment step in which it is judged whether or not each of the registered objects 
registered in the registration step is the same as or similar to the target object photographed in the 
photographing step based on the evaluation value calculated in the image comparison step. 

65. (withdrawn): A machine-readable record medium as claimed in claim 64, wherein 
the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the reflectance measured in the reflectance measurement step are stored as the registered 
data. 
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66. (original): A machine-readable record medium as claimed in claim 64, wherein the 
registration step includes: 

a 3-D shape measurement step in which the 3-D shapes of all or part of the one or more 
registered objects are measured; 

a color/intensity measurement step in which the registered object is photographed and 
thereby information concerning color or intensity of the registered object is obtained; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the color/intensity information obtained in the color/intensity measurement step are stored as 
the registered data. 

67. (withdrawn): A machine-readable record medium as claimed in claim 64, wherein 
the registration step includes: 

a 3-D shape measurement step in which the 3-D shapes of all or part of the one or more 
registered objects are measured; 

an average shape generation step in which an average 3-D shape is generated as the 
average of one or more of the 3-D shapes measured in the 3-D shape measurement step; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step, 

the average 3-D shape generated in the average shape generation step and the reflectance 

measured in the reflectance measurement step are stored as the registered data. 
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68. (original): A machine-readable record medium as claimed in claim 64, wherein the 
illumination correction step includes: 

an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose estimated in the 
position/pose determination step and the data registered in the registration step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

69. (original): A machine-readable record medium as claimed in claim 68, wherein: 
the illumination correction step further includes an illumination variation image space 

generation step in which an illumination variation image space which is spanned by the 
illumination variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

70. (original): A machine-readable record medium as claimed in claim 69, wherein: 

in the illumination variation image space generation step, basis vectors of a space that 

almost accommodates image variation due to the illumination variation are generated by 
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conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

71. (original): A machine-readable record medium as claimed in claim 68, wherein the 
illumination correction step further includes an illumination condition variation step in which 
various illumination conditions are set and generated to be used in the image generation step. 

72. (withdrawn): A machine-readable record medium as claimed in claim 64, wherein: 
the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a texture image photographing step in which the registered object is photographed under 
various illumination conditions and thereby texture images of the registered object are obtained; 
and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step 
and the texture images obtained in the texture image photographing step are stored as the 
registered data, and 
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the illumination correction step includes: 

an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose determined in the 
position/pose determination step and the 3-D shapes and the texture images of the registered 
object registered in the registration step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

73. (withdrawn): A machine-readable record medium as claimed in claim 72, wherein 
the illumination correction step further includes an illumination variation image space generation 
step in which an illumination variation image space which is spanned by the illumination 
variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

74. (withdrawn): A machine-readable record medium as claimed in claim 73, wherein: 
in the illumination variation image space generation step, basis vectors of a space that 

almost accommodates image variation due to the illumination variation are generated by 
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conducting the principal component analysis (PCA) to the illumination variation images 
generated in the image generation step, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

75. (original): A machine-readable record medium as claimed in claim 64, wherein in 
the position/pose determination step, a predetermined position/pose is adopted as the 
position/pose of the target object in the input image to be used in the illumination correction step. 

76. (original): A machine-readable record medium as claimed in claim 64, wherein in 
the position/pose determination step, a position/pose inputted from outside is adopted as the 
position/pose of the target object in the input image to be used in the illumination correction step. 

77. (original): A machine-readable record medium as claimed in claim 64, wherein in 
the position/pose determination step, the position/pose of the target object in the input image 
obtained in the photographing step is estimated to be used in the illumination correction step. 

78. (withdrawn): A machine-readable record medium as claimed in claim 77, wherein: 
the registration step includes: 
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a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 

a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; 

a first feature point extraction step in which feature points of the registered object are 
extracted based on the 3-D shape measured in the 3-D shape measurement step and the 
reflectance measured in the reflectance measurement step and the positions of the extracted 
feature points are obtained; and 

a data storage step in which the 3-D shapes measured in the 3-D shape measurement step, 
the reflectance measured in the reflectance measurement step and the feature point positions 
obtained in the first feature point extraction step are stored as the registered data, and 

the position/pose determination step includes: 

a second feature point extraction step in which feature points corresponding to those 
extracted in the first feature point extraction step are extracted from the input image obtained in 
the photographing step and the positions of the extracted feature points are obtained; and 

a position/pose calculation step in which the position/pose of the target object in the input 
image is estimated based on the 3-D shape and the feature point positions stored in the data 
storage step and the input image feature point positions obtained in the second feature point 
extraction step. 

79. (withdrawn): A machine-readable record medium as claimed in claim 78, wherein 
the illumination correction step includes: 
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an image generation step in which images of each registered object in the same 
position/pose as the target object in the input image and under various illumination conditions 
are generated as illumination variation images by use of the position/pose estimated in the 
position/pose determination step and the 3-D shape and the reflectance stored in the data storage 
step; and 

an illumination condition estimation step in which an image that is the most similar to the 
input image obtained in the photographing step is generated as the reference image by use of the 
illumination variation images generated in the image generation step. 

80. (withdrawn): A machine-readable record medium as claimed in claim 79, wherein: 
the illumination correction step further includes an illumination variation image space 

generation step in which an illumination variation image space which is spanned by the 
illumination variation images generated in the image generation step is generated, and 

in the illumination condition estimation step, the image that is the most similar to the 
input image is generated as the reference image from the illumination variation image space 
generated in the illumination variation image space generation step. 

81. (withdrawn): A machine-readable record medium as claimed in claim 80, wherein: 
in the illumination variation image space generation step, basis vectors of a space that 

almost accommodates image variation due to the illumination variation are generated by 
conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 
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in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors generated in the 
illumination variation image space generation step, and the image that is the most similar to the 
input image is generated as the reference image by use of the basis vectors and based on the 
inner products. 

82. (withdrawn): A machine-readable record medium as claimed in claim 81, wherein 
the illumination correction step further includes an illumination condition variation step in which 
various illumination conditions are set and generated to be used in the image generation step. 

83. (previously presented): A machine-readable record medium storing one or more 
programs for instructing one or more computers, devices, MPUs (Microprocessor Units), etc. to 
execute an image comparison process comprising the steps of: 

a registration step in which 3-D data of all or part of one or more registered objects are 
obtained and registered; and 

a comparison step in which 2-D data of a target object is obtained and the obtained 2-D 
data is compared with the data registered in the registration step for conducting judgment 
concerning the similarity/sameness between the target object and each of the one or more 
registered objects., wherein: 

the registration step includes: 

a 3-D shape measurement step in which the 3-D shape of each registered object is 
measured; 
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a reflectance measurement step in which the reflectance at each position on the surface of 
the 3-D shape of the registered object is measured; 

an image generation step in which images of each registered object under various 
illumination conditions are generated as illumination variation images; 

an illumination variation image space generation step in which an illumination variation 
image space which is spanned by the illumination variation images generated in the image 
generation step is generated; and 

a data storage step in which the illumination variation image space generated in the 
illumination variation image space generation step is stored as the registered data, and 

the comparison step includes: 

a photographing step in which the target object is photographed and thereby an input 
image is obtained; 

an illumination condition estimation step in which an image of each registered object that 
is the most similar to the input image is generated as a reference image from the illumination 
variation image space stored in the data storage step; 

an image comparison step in which each reference image generated in the illumination 
condition estimation step is compared with the input image obtained in the photographing step 
and thereby an evaluation value concerning the similarity between the two images is calculated; 
and 

a judgment step in which it is judged whether or not each of the registered objects 

registered in the registration step is the same as or similar to the target object photographed in the 

photographing step based on the evaluation value calculated in the image comparison step. 
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84. (original): A machine-readable record medium as claimed in claim 83 , wherein: 
in the illumination variation image space generation step, basis vectors of a space that 

almost accommodates image variation due to the illumination variation are generated by 
conducting principal component analysis (PCA) to the illumination variation images generated in 
the image generation step, and 

in the data storage step, the basis vectors generated in the illumination variation image 
space generation step are stored as the registered data, and 

in the illumination condition estimation step, inner products are obtained between the 
input image obtained in the photographing step and each of the basis vectors stored in the data 
storage step, and the image that is the most similar to the input image is generated as the 
reference image by use of the basis vectors and based on the inner products. 

85. (withdrawn): A machine-readable record medium as claimed in claim 65, wherein in 
the 3-D shape measurement step, the 3-D shapes are obtained by reading data or drawings. 

86. (original): A machine-readable record medium as claimed in claim 66, wherein in 
the 3-D shape measurement step, the 3-D shapes are obtained by reading data or drawings. 

87. (withdrawn): A machine-readable record medium as claimed in claim 72, wherein in 
the 3-D shape measurement step, the 3-D shapes are obtained by reading data or drawings. 
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88. (withdrawn): A machine-readable record medium as claimed in claim 65 , wherein in 
the reflectance measurement step, the reflectance is obtained by reading data or drawings. 

89. (original): A machine-readable record medium as claimed in claim 64, wherein in 
the photographing step, the input image is obtained by scanning a film, a photograph or printed 
matter. 

90. (original): A machine-readable record medium as claimed in claim 64, wherein the 
judgment step is executed forjudging which registered object matches the target object. 

91 . (original): A machine-readable record medium as claimed in claim 64, wherein the 
judgment step is executed for searching for one or more registered objects that are similar to the 
target object. 

92. (previously presented): A machine-readable record medium as claimed in claim 64, 
wherein the registered objects are automobiles. 

93. (previously presented): A machine -readable record medium as claimed in claim 64, 
wherein the registered objects are human faces. 

94. (previously presented): An image comparison device as claimed in claim 21, 
wherein the registered objects are automobiles. 
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95. (previously presented): An image comparison method as claimed in claim 52, 
wherein in the photographing step, the input image is obtained by scanning a film, a photograph 
or printed matter. 

96. (previously presented): An image comparison method as claimed in claim 52, 
wherein the judgment step is executed forjudging which registered object matches the target 
object. 

97. (previously presented): An image comparison method as claimed in claim 52, 
wherein the registered objects are automobiles. 

98. (previously presented): A machine-readable record medium as claimed in claim 83, 
wherein the registered objects are automobiles. 

99. (previously presented): A machine-readable record medium as claimed in claim 83, 
wherein the registered objects are human faces. 

100. (new): An image comparison method comprising: 

determining a pose of an object based on a 2-D image that is obtained by photographing 
the object; 
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generating an image of the object in that pose, making use of 3-D shape data, under an 
illumination condition similar to one under which the object was photographed; and 

examining similarities between the object and the 3-D shape data by comparing the 2-D 
image of the object with the generated image. 

101. (new): An image comparison device comprising: 

a photographing means which obtains a 2-D image of an object; 

a determination means which determines a pose of the object based on the 2-D image; 

a generation means which generates an image of the object in the pose under an 
illumination condition similar to one under which the object was obtained by using 3-D shape 
data; and 

an examination means which examines similarities between the object and the 3-D shape 
data by comparing the 2-D image and the generated image. 

102. (new): A machine-readable record medium which stores a program for 
performing an image comparison method, the method comprising: 

determining a pose of an object based on a 2-D image that is obtained by photographing 
the object; 
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generating an image of the object in that pose, making use of 3-D shape data, under an 
illumination condition similar to one under which the object was photographed; and 

examining similarities between the object and the 3-D shape data by comparing the 2-D 
image of the object with the generated image. 



42 



